Development of Novel Lip-Reading Recognition Algorithm
نویسندگان
چکیده
منابع مشابه
Toward movement-invariant automatic lip-reading and speech recognition
We present the development of a modular system for flexible human–computer interaction via speech. The speech recognition component integrates acoustic and visual information (automatic lip-reading) improving overall recognition, especially in noisy environments. The image of the lips, constituting the visual input, is automatically extracted from the camera picture of the speaker’s face by the...
متن کاملComputer-Assisted Lip Reading Recognition for Hearing Impaired
Within the communication process of human beings, the speaker’s facial expression and lip-shape movement contains extremely rich language information. The hearing impaired, aside from using residual listening to communicate with other people, can also use lip reading as a communication tool. As the hearing impaired learn the lip reading using a computer-assisted lip-reading system, they can fre...
متن کاملAn Efficient Lip-reading Method Using K-nearest Neighbor Algorithm
Many studies have been carried out on lip reading, most of those works are based on color images, while some essential features might not be obtained, like inner lip information. In this paper, RGBD camera will be introduced for improving the recognition rate of lip reading. We try to complete lip reading through using only gray-scale images. Thirteen groups of words are given, and we present e...
متن کاملDevelopment of communication support system using lip reading
This paper develops an entire communication support system for speech handicaps using lip reading. Our system is a high level system and consists of a face detector using Viola-jones method, lip detector based on active appearance model, utterance section detector, determined phrase recognizer using DP matching, camera controller, and message output. We implemented our system in the commercial ...
متن کاملLip-reading from parametric lip contours for audio- visual speech recognition
This paper describes the incorporation of a visual lip tracking and lip-reading algorithm that utilizes the affine-invariant Fourier descriptors from parametric lip contours to improve the audio-visual speech recognition systems. The audio-visual speech recognition system presented here uses parallel hidden Markov models (HMMs), where a joint decision, using an optimal decision rule, is made af...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2017
ISSN: 2169-3536
DOI: 10.1109/access.2017.2649838